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[57] ABSTRACT 

The system and method is disclosed for remotely controlling 
an application program over a network. The system includes 
an application interception module and remote display mod- 
ule. The remote display module is transported across the 
network and executed on the user system in response to a 
user's request to provide on-demand remote control of an 
application program. The application interception module 
captures an I/O stream generated by an application program, 
converts it to remote control protocol messages and trans- 
ports them across a network to the remote display module 
executing in the user system. The remote display module 
converts the remote control protocol messages to system 
calls compatible with the operating system environment fo 
the users computer. Likewise, the remote display module 
converts system calls to the local resource interface in the 
user's computer to remote control protocol messages which 
are transported across the network to the application inter- 
ception module. The application interception module inter- 
face converts the remote control protocol messages to sys- 
tem calls for the application program. In this manner, output 
from the application program is provided to the user's 
computer and input actions at the user's computer are 
provided to the application program. Preferably, the remote 
display modules and application programs are presented 
through HTTP servers over a network to a user's system 
which uses a browser having a JAVA interpreter to execute 
the remote display module and convert the remote control 
protocol messages. 

18 Claims, 4 Drawing Sheets 
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METHOD AND SYSTEM FOR ON DEMAND 
DOWNLOADING OF MODULE TO ENABLE 
REMOTE CONTROL OF AN APPLICATION 
PROGRAM OVER A NETWORK 

FIELD OF THE INVENTION 

This invention relates to remote execution of computer 
programs and, more particularly, to remote execution of 
computer programs over a network. 

BACKGROUND OF THE INVENTION 

Selling computer software for home and business appli- 
cations is a major market. In the retail market, competition 
is fierce in getting a program, sometimes called titles, before 
a consumer to be considered in the purchasing decision. 
Shelf space for new titles is extremely limited and every title 
for every publisher simply cannot be displayed. 
Consequently, software publishers look for other channels 
that can be used to get titles before consumers. 

One of the other channels used by software publishers or 
manufacturers is direct advertising in computer publications. 
Another channel is direct marketing to potential consumers 
of computer software. However, accurate information about 
the programs is difficult to obtain through these channels. 
For example, the advertising copy may concentrate on the 
features provided by the software and, because space is 
limited, not disclose all the hardware and support software 
required for executing the advertised program. A review of 
the program requirements when the user orders the software 
or views its packaging at a retail outlet may form an 
impression within the consumer that the manufacturer's 
advertising was merely hype. This, in turn, may lead the 
consumer to view advertising information for all software 
products with a measure of skepticism. 

In an effort to fully inform the potential purchaser about 
the program being offered, some manufacturers offer dem- 
onstration versions of their products. These demonstration 
versions may contain prepared examples of the capabilities 
of the offered software or they may contain a fully opera- 
tional version with a time deactivation feature. The time 
deactivation feature permits the program to execute for only 
a limited time following its installation. In this manner, the 
consumer is able to test all of the features of the software, 
the ease in which the consumer can use the software, and the 
compatibility of the output of the software with other 
application programs which the consumer uses on their 
system. To disable the time deactivation feature, the con- 
sumer must purchase the software to obtain the commands 
for disabling the time deactivation feature or to receive a 
copy of the software without the time deactivation feature. 

While demonstration software more fully informs con- 
sumers about the capability and user friendliness of the 
software, it does suffer from an important limitation — 
timelines. Many consumers are more likely to make a 
purchasing decision favorable to the seller if they are 
presented the product when the consumer's interest is active. 
If the demonstration version of the program is shipped on a 
diskette, the consumer may be busy when it arrives and 
simply never attempt to install the demonstration version for 
evaluation. Additionally, the consumer may have become 
aware of another software product or forthcoming develop- 
ment which the consumer thinks better addresses the con- 
sumer's need. Thus, the opportunity to favorably impress a 
consumer may have evaporated by the time the demonstra- 
tion software has been placed in the hands of the consumer. 

To make software available more quickly, some manu- 
facturers have made their demonstration software available 
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through downloading facilities. To obtain a copy of the 
software, the consumer's computer system communicates 
with the download facility so that a copy of the program may 
be transferred through a modem and over a telephone line to 

5 a modem associated with the coasumer's system. While this 
approach reduces the time between the consumer's request 
for the software and its delivery, it still requires the con- 
sumer to contact the download facility for a copy of the 
program in response to advertising in a publication. Since 

10 the consumer's computer may not be accessible at the time 
that the publication is read, the consumer's interest may 
wane before she uses her computer system again. 

A promising environment which appears to address many 
of the timing problems for the marketing of software is the 

15 Internet. The Internet is a publicly available network of 
computer networks that spans, not only the United States, 
but many parts of the world as well. To access the informa- 
tion on the Internet, a user uses a computer coupled to the 
Internet through an Internet server. These servers include 

20 programs which support the physical, data link, network and 
transport layers necessary for communication among the 
servers on the Internet. In this way, computers on a network 
associated with one server may communicate with a com- 
puter associated with another server and the messages 

25 between the computers may be relayed by intervening 
servers. 

The importance of the Internet as a commercial market- 
place was enhanced by the development of the Hypertext 
Transport Protocol (HTTP). This protocol is implemented 

30 with the Hypertext Markup Language (HTML). By using 
HTTP, documents written in HTML containing images and 
text may be presented on a server coupled to the Internet. 
The presented documents may then be retrieved and their 
contents graphically displayed. To peruse the HTML docu- 

35 ments available through the servers of the Internet, a user's 
computer uses an application program called a browser. The 
browser communicates with servers using HTML and HTTP 
to request, retrieve, and display HTML documents on a 
user's computer. Such browsers may also retrieve a HTML 

40 document for storage on a user's system. Thus, a server on 
the Internet may present information about a software pro- 
gram in a graphical manner that is as impressive as any print 
ad and also support a download of the program to the user's 
system in response to a user's request for a demonstratio 

45 program. Thus, the viewing of the information that raises 
user's interest in a program is contemporaneous with th 
user's receipt of the program. 

While the Internet, HTTP and HTML provide a commer- 
cially viable marketplace for software advertising and prod- 

50 uct demonstration, there are still limitations that restrain the 
effectiveness of this type of marketing once the consumer 
leaves the manufacturer's server site with the demonstration 
product. For one, the consumer must still install the dem- 
onstration product on the consumer's computer system. To 

55 do this, the consumer must still be knowledgeable about the 
hardware and software for his computer system to respond 
to the information prompts generated by the installation 
program for the demonstration product. This information 
includes knowledge about system memory, operating system 

60 version, monitor display size and video capability. As a 
result, the consumer may not be able to install the demon- 
stration program properly and the program may abort its 
execution as a result. Just as unproductive, the consumer 
may become so frustrated during the installation procedure 

65 that he simply postpones the activation of the program and 
there is no way of ensuring the consumer later activates the 
program for the demonstration. Even if the consumer installs 
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the program with relative ease, the consumer* s urifamiliarity second computer may establish oa-demand remote control 

with the capabilities of the demonstrated program may lead of the application program on the first computer to provide 

the user to improperly evaluate the program. All of these input to and view output from the application program at the 

possibilities negatively impact the likelihood that a con- first computer. 

sumer will make a decision to purchase the software. 5 The method of the present invention includes the steps of 

One way to overcome the limitations still present in the transporting a remote display module from a first computer 

Internet environment is to provide the user with access to the l ° a second computer, executing the remote display module 

application program without requiring the user to execute at ^second computer to establish communication between 

rr r & n o a user m terface to computer resources at the second com- 

program m her own computer system, flowing a user and ^ ^ ^ throu ^ ^ remQte & u 

to remotely control an application on another computer io moduk) and launching a ^ appHcatio r p rogram and apphca- 

coupled through a network is known m the software support tion mtcrception module interface at the first computer to 

and maintenance environment. Such remote control permits establish communication between the application intercep- 

a technician located at a customer service site to execute the tion mo dule and the remote display module whereby input/ 

application program on a customer's computer from a output (I/O) messages are communicated between the appli- 

remote location to try and duplicate the problem the cus- 15 cation program and the user interface at the second 

tomer is experiencing or to examine certain parameters in computer. 

the program to ascertain resource problems which may be Preferably, a remote control service publisher (RCSP) 
causing the customer's problems. Normally, the remote server, which is preferably a HTTP server displaying HTML 
access to the customer's computer is through a modem and documents, provides information about the application pro- 
telephone line. That is, the communication is from one point, 20 grams available for use and demonstration. The HTML 
the service site, to the other point, the customer's computer. documents retrieved from the RCSP contain tags which may 
Other remote control programs may control an application be used by a user at the second computer to send a request 
executing on another computer over a network. One for an application program to the RCSP. Browsers, which 
example of a protocol which supports such remote control are well known, are used by the second computer to view 
over a network is the X protocol. In this type of control, « HTML documents from the RSCP In response to an acti- 
communication between the controlling and controlled com- vation rec l uest b Y a ^ ^e RCSP server sends a file 

puters is not necessarily point to point. ? C * xccutabl * c ? de £ r ^ remote m ° dulc 

(RDM) to the browser. Preferably, the browser includes an 

Remote control programs, both network and point-to- interpreter which executes the RDM. This execution opens 

point which are currently known, require a component of the an a pp Uca tion window for the remote display module and 

remote control program to be resident on both computers. me remote display module communicates with the local 

That is, the components necessary to support remote control resource interface in the user's computer. The RDM then 

must be installed on both computers prior to any attempt to sends a request for activation of the requested application 

control one of the computers remotely. Installation of the program to a remote application server (RAS). The RAS 

program to support remote control requires a consumer launches the requested application program along with an 

knowledgeable about her system parameters or a technician 35 application interception module (AIM) and/or a protocol 

of the service company who possesses the requisite knowl- translation and optimization module (PTOM). The AIM 

edge. The system parameters and local resources include the and/or PTOM converts I/O messages in a first I/O stream 

input/output (I/O) components of the system which, along protocol for the local resource interface of the computer 

with the corresponding support software, form the user executing the application program to remote control proto- 

interface to the computer system. These resources include a 40 co1 messages in a remote control protocol. The remote 

mouse, keyboard, monitor and communication ports. ^P 1 ^ modulc bein S executed by the browser converts the 

„„..,. , . , remote control protocol messages it receives from the AIM 

What is needed is a remote control program that does not pT0M tQ T/Q messages in the second I/0 protocol for 

require pre-installation in order to operate. delivery to the local resource interface at the user's com- 

What is needed is a way to provide potential customers 45 puter and converts the user's input captured from the local 

with on-demand access to an application program without resource interface in the user's computer to remote control 

requiring the user to download and install the program on the protocol messages in the remote control protocol. These 

user's system. remote control protocol messages are transmitted to the RAS 

What is needed is a way to use the Internet or other for delivery to the AIM and/or PTOM for conversion to the 

network to transparently provide demonstration software. 50 first I/O protocol. 

The application interception module (ATM) monitors the 
system calls made by the application program to the local 
The limitations of previously known systems have been resource interface of the first computer. The local resource 
overcome by a system and method performed in accordance interface directs the output of the application program to 
with the principles of the present invention. The system 55 local resources, such as a video display card or sound card, 
includes an application interception module (AIM) for con- so the program communicates with a user. The AIM inter- 
verting between a first input/output (I/O) stream protocol cepts the system calls of the application program to the local 
used by an application program and a first remote control resource interface and provides the application program with 
protocol, the I/O stream protocol being used to interface the data from the local resource interface of a remote computer, 
application program to local resources on a first computer; 60 The data from the remote local resource interface is from 
and a remote display module for converting between the first input devices such as a mouse or keyboard and is contained 
remote control protocol and a second I/O stream protocol within remote control protocol messages. The RAS may also 
said second I/O stream protocol for communicating with activate a protocol translation and optimization module 
local resources for a second computer through a user (PTOM). The PTOM is used to encapsulate messages from 
interface, the remote display module being transported from 65 AIM in a known remote control protocol within a remote 
the first computer to the second computer for execution by control protocol used for the remote control protocol mes- 
the second computer upon receipt whereby a user at the sages. 
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Most preferably, the PTOM is used to reduce the latency user need not install any software or directly supply any 

in the communication time associated with networks. Most information about the user's computer system to the server 

Internet users couple to the Internet through a telephone through which application access is possible. Instead, the 

twisted pair line. The bandwidth for this type of communi- interface to the application program is transparent to the user 

cation conduit is relatively narrow. To reduce response s and only requires the execution of a RDM on the user's 

times, the PTOM has an associated cache memory in which machine. The RDM may be provided and used by the user's 

data about the system in which the RDM is executing are computer through the user's browser or through the embed- 

stored. The PTOM parses system calls received from the ^ of a program se gment in the user's computer using an 

AIM to determine whether the call is requesting information HTML document. 

stored in the cache memory. If the information is stored in nn tl j.l j * j u ^ * *u * 

. . * */■ J - * j* j jj_ j These and other advantages and benefits of the present 

the cache memory, the information is retrieved and returned . ., . . ° r ,. t .„ . * c 

t . • t • j • • i invention are evident to one of ordinary skill in the art trom 

to the application. In this way, the time associated with the f „ , , , , . , J , 

, r \ c Al A * j , i . A r , the following detailed description and accompanying draw- 
transmission or the system call to and the receipt of the ° r r 

ings 

response from the RDM is avoided. & " 

Preferably, the RDM of the present invention is imple- 15 BRIEF DESCRIPTIONS OF THE DRAWINGS 
mented in an interpretative language such as the JAVA 

language. JAVA capable browsers include an interpreter for The accompanying drawings, which are incorporated and 

JAVA language instructions. Thus, an RDM implemented in constitute a part of this specification, illustrate embodi- 

the JAVA language may be executed by the interpreter in ments of the invention and, together with the general 

these JAVA capable browsers. When a JAVA capable 20 description given above, and the detailed description of the 

browser is used, the RDM may be identified in an applet tag embodiments given below, serve to explain the principles of 

of a HTML document. In response to activation of the applet me invention. 

tag, the RCSP may retrieve the identified file containing the FIG. 1 is a block diagram of a system in which the system 

executable code for the RDM and transfer the file to the and method of the present invention are used to remotely 

JAVA capable browser. The interpreter in the browser may 2 s access an application program; 

then execute the transported RDM. Because the RDM is FIG. 2 is a schematic depiction of the communication 

identified as an application program for the user's computer, layers present in a network environment for an application 

it is provided with its own communication access to the local program; 

resource interface for the user's computer The RDM may FIG. 3 is a block diagram of a protocol translation and 

remain active to present output from the application program 30 optimization module (PTOM) in nG . 1; 

at the RAS to the RDM at the user's computer and to . . . ~ 

generate remote control protocol messages corresponding to • 4Als a flow chart of the P">«ss for providing remote 
the user's input actions for transmission to the AIM or controI access t0 a user over a network; mi 
PTOM at the RAS. When the demonstration is concluded, FIG- 4B is a flow chart of the process performed by a 
the RDM at the user's computer terminates along with its 35 PTOM to reduce latency in communication over a network, 
access path to the local resource interface Likewise, the DETAILED DESCRIPTION OF THE PRESENT 
RAS terminates the application program along with any INVENTION 
corresponding AIM and PTOM. This preferred implemen- 
tation does not require RDMs specifically designed for each A system in which the principles of the present invention 
possible operating system environment. Instead, the RDM 4 p are implemented is shown in FIG. 1. The system 10 includes 
obtains sufficient information from the browser and its a remote control service publisher server 12 which is 
communication path to the local resource interface to oper- coupled through a network 14 to a user computer 16. User 
ate in the user's computer without pre-installation. system 16 may be coupled through an access server (not 

Translation of system calls for one type of operating shown) such as that provided by a Internet service provider, 
system to another type may be performed by the AIM or 45 Coupled to RCSP 12 and to network 14 is a remote appli- 
PTOM. Alternatively, the system and method of the present cation server (RAS) 20, Remote application server 20 is 
invention may maintain a library of RDMs, each of which is used to launch an application program 22 with a correspond- 
designed for a specific operating system environment. In ing application interception module (AIM) 24 in response to 
response to a request for a program demonstration, the RCSP a request from user system 16. Normally, application pro- 
selects the file containing the executable code for the RDM 50 gram 22 communicates with local resource interface 28 
for the operating system environment that corresponds to the using system calls having an I/O protocol to provide output 
parameters identified in the request for the program activa- to and receive input from the I/O device coupled to the 
tion received from the user's computer. The file for the RDM computer on which application program 22 is executing, 
is transmitted and executed in the user's computer. The RAS 20 may also launch a protocol translation and optimi- 
execution of the embedded program results in a communi- 55 zation module (PTOM) 26 if AIM 24 encapsulates the I/O 
cation path to the local resource interface being generated stream or system calls of program 22 with a previously 
for the RDM. The RDM then interprets the messages known remote protocol or latency problems are expected 
generated by the AIM or PTOM at the RAS to provide the with the bandwidth of network 14. Either AIM 24 or PTOM 
user access and control of the application program. This 26 communicates with user system 16 through network 14. 
alternative implementation does not require pre-installation, 60 Remote display module (RDM) 18 is transported from 
but does require more operating system parameter informa- RCSP 12 to user system 16. Once RDM 18 is executing on 
tion to correctly select an RDM to transport to the user's user system 16, it provides a seamless and transparent 
computer. interface between the local resource interface of system 16 

The system and method of the present invention provides and application program 22. 

a network user with access and control over an application 65 User system 16 is typically a personal computer, although 

program so that the user may experience the look and feel of other computer platforms may be used. User system 16 

the program as well as try the features of the program. The communicates with servers over network 14 through a 
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communication program such as browser 30. User system 
16 also includes local resource interface 32 which couples 
application programs on system 16, such as browser 30, to 
input/output (I/O) devices such as a mouse, keyboard, or 
monitor. Local resource interface 32 is sometimes called a 
user interface. Application programs executing on user sys- 
tem 16 communicate with local resource interface 32 using 
system calls having an I/O protocol. Usually, the I/O pro- 
tocols of the computer executing application program 22 and 
user system 16 are different. User system 16 may implement 
any known operating system such as DOS, DOS with 
Windows, Windows '95, Unix, O/S 2, or an Apple operating 
system. The operating system is used to launch application 
programs within user system 16 which process information 
and communicate with the user through the devices coupled 
to local resource interface 32. Browser 30 is a type of 
application program which is used to convert the user's 
actions received through local resource interface 32 into 
commands recognized for retrieval of information over 
network 14. Likewise, browser 30 converts information 
retrieved through network 14 into a suitable system calls for 
displaying the retrieved information through local resource 
interface 32 to the user. When network 14 is the Internet, 
browser 30 is preferably capable of communicating over 
network 14 in the Hypertext Transport Protocol (HTTP). 
The documents communicated over the Internet are prefer- 
ably written in Hypertext Markup Language (HTML). 

RCSP 12 and RAS 20, for Internet applications, are 
preferably HTTP servers. That is, the server supports the 
HTTP communication protocol for presenting and transmit- 
ting HTML documents over the Internet. Such servers are 
well known and may be purchased from such well-known 
sources as NCSA, NetScape, and CERN. Preferably, RCSP 
12 presents HTML documents which describe the applica- 
tion programs available for demonstration through RAS 20. 
A user at system 16 may retrieve the HTML document using 
browser 30 and view the contents of the document through 
local resource interface 32. Preferably, the HTML document 
displaying the information about a selected application 
program includes an applet tag field for activating a dem- 
onstration of the application program. When a user activates 
the applet tag field, browser 30 transmits a request for 
activation of the selected application program along with 
attributes and parameters describing the operating system 
environment of system 16. Some exemplary applet tags are: 

<APP class="rdm" platform="win31" colordepth- 
"8bif> 

<APP class="rdm" platform=" macros" > 

<APP class="rdm" platform="pcxserver" colordepth« 

"mono" transports" winsock" 
<APP class="rdm_internet" platfornWunix" browser =* 

"netscape"> 

<APP class-" rdm_ether" platform -"win95" browser- 

"mosaic"> 

From these exemplary tags, information about user system 
16 is provided. For example, the "platform" field may 
identify the user system 16 as operating under Windows 
version 3.1, a Macintosh operating system, X server, Unix 
operating system, or Windows 95. Likewise, the color 
capability, type of browser, or communication socket may 
also be identified. 

Because the request for a demonstration of an application 
program results in the launching of an application program 
which a user at system 16 controls, RCSP may include a 
security component, such as TCP wrapper available from 
Wietse Venema of Eindhoven University of Technology, the 
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Netherlands, which parses the attribute and parameter infor- 
mation to ascertain information which may be used to deny 
access to the application program. In response to an 
approved request for application activation, RCSP 12 com- 

5 municates a RDM 18 to browser 30. RAS 20 may reside on 
the same computer implementing RCSP 12 or it may reside 
on its own computer platform coupled to RCSP 12 either 
through a network or dedicated communication line. RAS 
20 preferably includes a library of application programs 

30 which may be made available for demonstration. RAS 20 
may also include additional security components to further 
scrutinize or interrogate user system 16 for information prior 
to launching an application for use. For example, RAS 20 
may, through RDM 18, interrogate a user for identification 

15 and a password prior to providing the user access to an 
application program. The application programs which RAS 
20 launches may be launched on the same computer imple- 
menting RAS 20 or RAS 20 may be coupled to a plurality 
of computers which may be used to launch one or more 

20 application programs. Use of a plurality of computers for 
launching application programs 22 is preferred as each 
computer may implement a different operating system envi- 
ronment so that a user may select an application program 
which executes under an operating system similar to the one 

25 on the user's system. Alternatively, AIM 24 or PTOM 26 
may be used to translate system calls compatible with the 
operating system on a computer executing application pro- 
gram 22 to system calls compatible with the operating 
system on a user's system. 

30 RAS 20 launches application programs 22 in an appro- 
priate operating system environment, whether it is on the 
computer implementing RAS 20 or one coupled to RAS 20. 
Each application program 22 has a corresponding AIM 24 
for communicating with the local resource interface 28 for 

35 the computer executing application program 22. Application 
interception module 24 of the present invention captures the 
I/O stream or system calls between application program 22 
and the local resource interface 28 and converts it to a 
remote control message in a remote control protocol. For 

40 output generated by application program 22, the remote 
control protocol messages are provided to browser 30 of 
user system 16 for processing in a manner to be discussed 
more fully below. PTOM 26 is launched by RAS 20. AIM 
24 uses a known remote protocol not recognized by RDM 18 

45 or the bandwidth of network 14 may cause latency problems. 
In the first situation, PTOM 26 encapsulates the known 
remote control protocol messages in the remote control 
protocol recognized by RDM 18. In the second case, PTOM 
26 allocates a portion of memory as a cache memory 30 to 

50 improve communication turnaround. 

An exemplary diagram of the layers and components 
comprising each layer for communication between an appli- 
cation program launched by RAS 20 and a browser 30 at 
user system 16 is shown in FIG. 2. The lowest layer is the 

55 link layer 50 which is comprised of the physical hardware 
and the datalink processing. The physical component 52 is 
the actual hardware for communicating a binary bit stream 
over a network. Datalink 54 is the processing to organize the 
binary bit stream into frames of data for processing by 

60 network layer 58. Network layer 58 includes the processing 
of the frame data to deliver data units to the transport layer 
of a specified computer. Common network processing 
includes routing and other network traffic management. 
Transport layer 60 communicates delivered data units to the 

65 correct application layer within the specified computer. For 
outgoing data, the transport layer provides sufficient infor- 
mation for the identification of the application layer in the 
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receiving computer. In Internet applications, the network window for RDM 18. In this way, browser 30 opens corn- 
layer uses the Internet protocol (IP) and the transport layer rminication between RDM 18 and local resource interface 32 
uses the Transport Communication Protocol (TCP). Hence, to provide user input actions to RDM 18 and through which 
the Internet is frequently referred to as a TCP/IP network RDM 18 may provide output to local resource interface 32. 
since these are the two protocols used to communicate s The transporting of the RDM 18 across the network to the 
between application programs and the network hardware. browser for execution does not require any information 

Application layer 66 is typically comprised of a session other than the identification of the operating system envi- 

component 68, presentation layer 70 and the application ronment for user system 16 which may be supplied through 

program 72. Session component 68 typically includes soft- the applet tag of a HTML document. This operating system 

ware for processing the interface between a particular user 10 environment identification is used to select a RDM which 

and the application program. In effect, the session layer is best corresponds to the operating system environment. Spe- 

the gateway for a user on the network to the application cific system parameters required for interfacing with local 

program. The presentation layer is the interface between the resource interface 32 are not required since they are pro- 

application program and the network interface for network vided by browser 30. Thus, RDM 18 of the present invention 

I/O operations. Local resource interface 74 is the interface 15 takes advantage of and supplements the structure present in 

between an application program and its corresponding I/O a JAVA capable browser to provide seamless and transparent 

components or graphical user interface (GUI) on the com- control over an application program 22 launched by RAS 20. 

puter executing the application program. In the present While browser 30 preferably supports the JAVA language 

invention, the I/O stream between application program 72 to take advantage of the interpreter provided within such a 

and local resource interface 74 must be captured and com- 20 browser, other browser implementations may be used to 

municated to the presentation layer to transport it across execute an RDM of the present invention. For example, a 

network 14 to another computer, such as user system 16. SAFETcl browser may utilize a mailcap entry to implement 

Heretofore, the capturing of such an I/O stream for delivery a RDM. The mailcap entry correlates the transported RDM 

to another application program has only been possible if the to a file type in the operating system environment of user 

program for capturing and delivering the I/O stream at each 25 system 16. This correlation information may be used to 

computer was installed in both computers prior to opening launch RDM 18 with its own application window so it may 

the communication between both computers. The system communicate with local resource interface 32 in user system 

and method of the present invention permit a first computer 16. Other schemes within the principles of the present 

to initiate communication with a second computer, transport invention may also be utilized. For example, information 

the program component which supports remote control 30 about the operating system environment for a user system 16 

between the two computers, activate the program compo- may be provided by a browser 30 in a Universal Resource 

nent and remotely control an application program at the Locator (URL) to RCSP 12 for selection of a corresponding 

second computer. This on-demand availability of remote RDM 18. This information may also be provided in a tag for 

control over another computer has been heretofore an extended HTML document. While these implementations 

unknown. 35 are in accordance with the principles of the present invention 

The advantages of the present invention are made possible in that no user installation of a RDM is required, these 

by a remote display module 18 which is transported from implementations are designed for specific environments and 

RCSP 12 to user system 16 prior to the launching of require more information for implementation than the 

application 22 by RAS 20. Although other systems are above -identified approach used with a JAVA capable 

known for transporting I/O streams across a network, these 40 browser. 

systems suffer from the limitations that a component must be The system and the method of the present invention may 

installed in a user's system prior to initiation of the com- be used to support the remote control of more than one 

munication for supporting the remote control session. For application program. For example, RAS 20 may launch an 

example, a protocol known as the X protocol is used for application program and corresponding AIM 24 and PTOM 

remote computing across a network. The X protocol cap- 45 26 on one computer and, in response to another request from 

tures an I/O stream between a local resource interface and an a second user, launch a second application program with its 

application program and encapsulates it in the transport and corresponding AIM and PTOM. As long as the communi- 

network protocol for a network. The X protocol defines cation cap ability of the communication server coupling both 

which computer on the network receives the I/O stream even computers to the network provides messages to and from the 

when the local resource interface of the computer receiving 50 AIMs and PTOMs for the respective applications in a timely 

the I/O stream is the same one in which the stream was manner, the operation of the system and method of the 

generated. However, for the X protocol to be functional, a X present invention remains the same, 

protocol server must be installed by the user at each com- AIM 24 is typically implemented by replacing a compo - 

puter on the network in order to enable the computer to nent of the operating system or a component of application 

receive an I/O stream from another computer over the 55 program 22. Known application programs written for the 

network. Windows environment execute system calls to the local 

In the present invention, there is no user installation of a resource interface drivers for various devices or computer 

remote control component prior to initiating the remote resources such as the video system, keyboard, or mouse. To 

control session. Instead, RCSP 12, after approving access to implement the present invention, AIM 24 traps the system 

an application program 22, selects a corresponding remote 60 calls to local resource interface 28 so the data stream being 

display module 18. This remote display module is commu- written to or received from the interface may be captured, 

nicated through network 14 to browser 30 within user AIM 24 then converts the I/O stream or system calls directed 

system 16. Preferably, the executable code for the RDM, to local resource interface 28 to remote control protocol 

which is preferably written in JAVA language, is transported messages in a remote control protocol. The remote control 

in a file across network 14 to browser 30 so browser 30 may 65 protocol messages are then encapsulated in the transport, 

execute RDM 18 with its internal interpreter. Execution of network and link layer protocols for transporting over the 

RDM 18 by the browser interpreter opens an application network to RDM 18 within user system 16. RDM 18 
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converts these remote control protocol messages to appro- display model for AIM 24. Likewise, RDM 18 conforms its 

priate applications calls for local resource interface 32 at system calls and corresponding parameters to a logical 

user system 16. In response to the output generated by the display model implemented for it. Thus, PTOM 26 must be 

system calls to local resource interface 32, a user usually designed to map the system calls and parameters for the 

provides data through an input device through local resource 5 logical display model of AIM 24 to the system calls and 

interface 32. RDM 18 captures the system calls from local parameters for the logical display model of RDM 18. If the 

resource interface 32 generated by the user's response and system calls or parameters for AIM 24 have corresponding 

converts them to remote control protocol messages in the system calls and parameters in RDM 18, a case statement for 

remote control protocol which are likewise encapsulated in directly mapping the system calls and parameters for AIM 

transport, network and link layer protocols for transporting 10 24 to RDM 18 may be implemented in PTOM 26. In this 

across the network to AIM 24. AIM 24 then converts the situation, RDM 18 may also include a direct mapping of the 

remote control protocol messages to system calls for local system calls and parameters for its logical display model to 

resource interface 28. In this way, output from application the corresponding system calls and parameters for the logi- 

program 22 is directed to the local resources available on cal display model of AIM 24. 

user system 16 and user input actions at user system 16 are is Where components of the logical display model for AIM 

provided to application program 22. 24 do not have a corresponding element in the logical 

PTOM 26 is launched by RAS 20 when AIM 24 includes display model of RDM 18, PTOM 26 must simulate the 

the capability of encapsulating an I/O stream in transport logical display model for AIM 24. That is, PTOM 26 must 

and network protocols. For example, if the application generate responses or provide data parameters to AIM 24 

program is written for the X protocol, AIM 24 already 20 which conform to the logical display model for AIM 24. Any 

includes the encapsulation of the I/O stream or system calls changes which should be reflected in the output at user 

in the transport and network protocols. Even if the I/O system 16 must be provided in remote control protocol 

stream is directed to the local resource interface in the messages to RDM 18. This may be achieved, for example, 

computer executing application program 22, it is encapsu- by having PTOM 26 maintain a binary image of the output 

lated and decapsulated within the computer prior to being 25 display or graphical user interface (GUI) at user system 16. 

delivered to local resource interface 28 for the computer Changes made to this image as a result of system calls from 

executing application program 22. Although this adds over- AIM 24 which do correspond to an system call in RDM 18 

head to the processing of the I/O stream for I/O operations are encapsulated for transport to and displayed at user 

within the computer executing application program 22, it system 16. 

provides a general scheme which supports the transporting 30 A block diagram of PTOM 26 is shown in FIG. 3. As 

of the I/O stream across a network. PTOM 26 is imple- shown in the Fig., PTOM 26 includes a command generator 

mented to permit AIM 24 to operate without modification 80, a reply generator 82 and a cache memory 84. The system 

for an X protocol or other known remote protocol. Instead, calls and parameters from AIM 24 may be considered 

PTOM 26 takes the encapsulated output of AIM 24 and commands and are typically of three types. These are display 

converts it to remote control protocol messages in the 35 instruction commands, status query commands, and attribute 

remote control protocol. PTOM 26 also converts remote commands. Display instruction commands are instructions 

control protocol messages from RDM 18 to encapsulated from AIM 24 to its logical display model which change the 

I/O streams for delivery to AIM 24. When the operating display being viewed by a user. Because the attributes of the 

system environment for user system 16 and the computer computer on which application program 22 is executing and 

executing application program 22 are not the same, PTOM 40 user system 16 may differ, the system call or parameters of 

26 optimizes the conversion of the system calk in one a call which change a display may need modification prior 

system to system calls in the other system. to be sent to RDM 18. Attributes are hardware characteris- 

For example, because RDM 18 is being executed by tics such as window types, color encoding schemes, and 

browser 30, it may interrogate browser 30 to obtain param- fonts supported, for example. If the attribute of the AIM 

eters regarding the video system of user system 16. These 45 logical display model corresponds to an attribute in the 

parameters include the pixel size of the monitor screen, the RDM logical display model, a direct mapping to the corre- 

color palettes for the screen, and the fonts supported by the sponding system call may be used. If the attribute does not 

system. These parameters are transmitted to AIM 24 or have a corresponding attribute, PTOM 26 may keep a 

PTOM 26 for use. Whenever an system call from application corresponding bit image of the display or GUI in memory, 

program 22 is intercepted and provided to AIM 24 or PTOM so update it in accordance with the display instruction 

26 for conversion to the remote control protocol, the param- command, and send the changed portion in a remote control 

eters for user system 16 are used. For example, if the system message to RDM 18. 

call is to a library routine for drawing a line, AIM 24 or A second type of command from AIM 24 is a status query 

PTOM 26 converts the parameters for drawing the line so command. This type of command is used to obtain the 

they correspond to the library routine on user system 16 and 55 characteristics of a display or GUI or the attribute settings of 

correspond to the pixel resolution of the screen. In this a computer. If the characteristic or attribute being queried 

manner, the user at system 16 views the operation of the has a corresponding attribute or characteristic in RDM 18, a 

application program in a seamless fashion even though the direct mapping is used to generate the remote control 

local resource interfacing at program 22 and user system are message to RDM 18 requesting the corresponding attribute 

different. 60 or characteristic. Otherwise, PTOM 26 simulates a response 

PTOM 26 is required to support the display model for consistent with the logical display model of AIM 24. To 

which AIM 24 is designed. That is the system calls and reduce communication latency, PTOM 26 may search cache 

parameters within those calls used by AIM 24 to drive a memory 84 to determine if the attribute or characteristic has 

display and receive input must be anticipated by PTOM 26 been received from RDM 18 before. If it has and it is stored 

in order to be able to convert the system calls received from 65 in cache 84, command generator 80 signals reply generator 

AIM 24 to remote control protocol messages. The design of 82 of PTOM 26 to retrieve it and incorporate it in a reply to 

the display which AIM expects may be called the logical AIM 24. 
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The third type of command is an attribute command. This 
type of command is used to set the attributes of a computer. 
Again, a direct mapping may be used if the attribute being 
set by the command has a corresponding attribute in RDM 
18. If PTOM 26 simulates the attribute, its status is updated 
in PTOM 26. 

Reply remote control protocol messages may be of five 
types — user input events, device characteristics, device 
errors, display model errors, and attribute status replies. 
Most user input events from RDM 18 are capable of direct 
mapping to a corresponding event in the logical display 
model for AIM 24. Events not supported by AIM 24 are 
ignored. PTOM 26 may process user events to prevent 
security breaches in the computer executing application 
program 22. 

Device characteristic and attribute status replies usually 
are directly mapped to a reply AIM message since command 
generator 80 of PTOM 26 only generates remote control 
protocol messages for attributes and characteristics in RDM 



RDM 18 also monitors calls to the local resource interface 
32 by input devices and converts the information in the 
system calls to remote control protocol statements for encap- 
sulation in the transport, network and link layer protocols by 
5 browser 30 for transporting across network 14 to AIM 24. 
AIM 24 then converts the remote control protocol messages 
to system calls for application program 22 (Block 110, 112). 
The conversion between the I/O protocol for the application 
program 22 and remote control protocol continues until the 
io program terminates. 

If PTOM 26 is launched with application program 22, it 
performs the method shown in FIG. 4B. That method begins 
by determining whether the message to be processed is a 
remote control reply or a remote control command message 
15 (Block 130). If the message is a remote control reply 
message, it is converted to an AIM reply for the application 
program (Block 132). If the remote control reply message 
contains attribute or characteristic information about user 
system 16 (Block 134), the data are stored in cache memory 



18 that correspond to AIM 24. If either type of reply is 20 84 (Block 136). The AIM reply is then converted to a system 



received which does not correspond to an attribute or 
characteristic in AIM 24, it is ignored. Preferably, the 
characteristics and attributes received from RDM 18 are also 
stored in cache 84 for responding to status query commands 
without requiring a message to be sent to RDM 18. 
Preferably, attributes and characteristics which conform to 
the logical display model for AIM 24 have allocated loca- 
tions in cache memory 84 to facilitate their retrieval. 

Device errors indicate that a system error occurred at user 
system 16, PTOM 26 may terminate the remote session in 
response or it may pass a corresponding error message to 
AIM 24, if one can be mapped. Preferably, application 
program 22 or PTOM 26 generates a display instruction 
command to inform the user of the error. Otherwise, the user 
does not understand the unresponsiveness of application 
program 22 or its termination. Display model errors occur in 
response to compatibility errors between the logical display 
models for AIM 24 and PTOM 26. Preferably, PTOM 26 
stores such replies in a log for later analysis 



call for local resource interface 32 by AIM 24 (Block 138). 
If the message is a remote control command message, 
PTOM 20 determines if a parameter stored in the cache 
memory is being requested (Block 140). If it is, reply 
25 generator 82 retrieves the data from cache 84 and builds an 
AIM reply message (Block 142). Otherwise, the command 
messages are converted to the remote control protocol 
(Block 144) and are transmitted across network 14 to user 
system 16 (Block 146). PTOM 26 continues to convert 
between the encapsulated system calls and the remote con- 
trol protocol until the user terminates the application pro- 
gram. 

In use, after installation of a browser, a user need not 
install additional software or provide additional parameters 
for the remote control of an application program. Instead, a 
user browses the Internet and, if the site browsed is an RCSP, 
the user selects the application program. The RCSP trans- 
ports an RDM to the user system for execution and the RAS 
launches an application program in response to a request 



30 
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A method for the remote control of an application pro- 40 from the RDM. The RDM then converts I/O streams for 
gram in accordance with the principles of the present transporting to the application program launched by the 
invention is shown in FIG. 4A. The method begins by the RAS and the AIM or PTOM corresponding to the launched 
presentation of a document describing an application pro- application program provides converted I/O streams to 
gram to a browser at a user's system (Block 100). In RDM 18 - In this wav > communication of input and output 
response to a user's request for activation of an application 45 operations are communicated between the application pro- 
program, RCSP 12 selects a RDM 18 which corresponds to g ram and me uscr system. 

the parameter and attribute information provided in the While the present invention has been illustrated by a 

application program request (Block 102). The selected RDM description of various embodiments and processes, and 

18 is transported across the network to the browser in user while me embodiments and processes have been described 

system 16 and browser 30 launches RDM 18 to establish 50 in considerable detail, it is not the intention of the applicant 



communication with local resource interface 32. RAS 20 
also launches the requested application program 22 and any 
corresponding AIM 24 and PTOM 26, if necessary (Block 
104). The computer executing the requested application 
program and user system 16 may now communicate over 
network 14 with one another. 

The method of FIG. 4A continues by monitoring the 
application program calls to its local interface or 
alternatively, monitoring the output of AIM 24 for the 
encapsulated I/O streams. If application program 22 gener- 
ates low level I/O calls, AIM 24 converts the I/O streams for 
the application program's local resource interface 28 into 
remote control protocol messages (Block 106). These 
remote control interface messages are then transported 
across network 14 to RDM 18 executing in user system 16 
(Block 108). RDM 18 converts the remote control protocol 
messages to system calls for the local resource interface 32. 
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to restrict or in any way limit the scope of the appended 
claims to such detail. Additional advantages and modifica- 
tions will readily appear to those skilled in the art. 
What is claimed: 

1. A system for on demand remote control of an applica- 
tion program comprising: 

an application interception module (AIM) for converting 
between a first input/output (I/O) stream protocol used 
by an application program and a first remote control 
protocol, the I/O stream protocol being used to inter- 
face the application program to local resources on a 
first computer; and 

a remote display module (RDM) for converting between 
said first remote control protocol and a second I/O 
stream protocol, said second I/O stream protocol for 
communicating with local resources for a second com- 
puter through a user interface, the remote display 
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module being transported from said first computer to 
said second computer for execution by said second 
computer upon receipt whereby a user at said second 
computer may establish on-demand remote control of 
the application program on the first computer to pro- 
vide input to and view output from the application 
program at said first computer. 

2. The system of claim 1 further comprising: 
a remote control service publisher (RCSP) server for 

selecting and transporting said remote display module 
in response to a user request for an application pro- 
gram. 

3. The system of claim 2 further comprising: 
a remote application server (RAS), said remote applica- 
tion server selecting an application program and cor- 
responding AIM for activation in response to a request 
for activation of an application program from said 
remote display module, said AIM corresponding to said 
selected application program communicating remote 
control protocol messages in said remote control pro- 
tocol with said remote display module. 

4. The system of claim 1 wherein said remote display 
module is executed by an interpreter in said second system 
to open an application window for said remote display 
module in said second computer system. 

5. The system of claim 3 further comprising: 
a browser at said second computer, said browser commu- 
nicating with said RCSP to select and receive said 
remote display module corresponding to said requested 
application program. 

6. The system of claim 5 said browser further comprising: 
an interpreter for executing said remote display module 

received from said RAS. 

7. The system of claim 1 further comprising: 
a protocol translation and optimization module (PTOM) 

for converting an I/O stream encapsulated in a second 
remote control protocol communicated between said 
PTOM and said AIM to said first remote control 
protocol. 40 

8. The system of claim 6 wherein said RCSP is a HTTP 
server and said remote display module is transported across 
a network to said second computer. 

9. The system of claim 8 wherein said remote display 
module is transported across said network in response to 45 
activation of an applet tag of a HTML document. 

10. The system of claim 1 further comprising: 

a PTOM for reducing communication latency between 
said first and said second computers; and 

a cache memory coupled to said PTOM, said PTOM 
retrieving data about said second computer from 
remote control protocol messages from said RDM and 
storing said data in said cache memory so that said data 
about said second computer may be communicated to 
said AIM in response to system calls received from said 
AIM whereby transmission of said system calls to said 
second computer are avoided. 

11. A method for providing on demand remote control of 
an application program comprising the steps of: 

transporting a remote display module from a first com- 
puter to a second computer; 

executing said remote display module at said second 
computer to establish communication between a user 



interface to computer resources at said second com- 
puter and said first computer through said remote 
display module; and 
launching an application program and application inter- 
ception module at said first computer to establish 
communication between said application interception 
module and said remote display module whereby input/ 
output (I/O) messages are communicated between said 
application program and said user interface at said 
second computer. 

12. The method of claim 11 wherein said remote display 
module is transported in an applet file. 

13. The method of claim 12 wherein said remote display 
15 module is transported in response to activation of an applet 

tag of a HTML document. 

14. The method of claim 11 wherein said remote display 
module is executed by an interpreter at said second com- 
puter. 

15. The method of claim 11 further comprising the steps 

of: 

converting I/O messages from said application program to 
remote control protocol messages for transmission to 
said remote display module at said second computer; 
and 

converting remote control protocol messages received 
from said application interception module to I/O mes- 
sages for said user interface at said second computer. 

16. The method of claim 15 further comprising the steps 
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converting I/O messages from said user interface to 
remote control protocol messages for transmission to 
said application interception module; and 

converting remote control protocol messages from said 
remote display module to I/O messages for said appli- 
cation program. 

17. The method of claim 11 further comprising the steps 

of: 

storing in a cache memory attribute data from remote 
control protocol messages received from said remote 
display module; and 

retrieving a portion of said attribute data from said cache 
memory in response to an I/O message from said 
application program requesting said attribute data. 

18. A method for providing on demand remote control of 
an application program, comprising the steps of: 

determining that a user at a first computer system desires 
remote control over an application at a second com- 
puter system; 

transporting over said network a remote control module to 
said second computer when demanded by said user, 
said remote control module enabling said first and 
second computer system to communicate remotely 
without pre-installing remote control software at said 
second computer prior to opening a communication 
session between the first and second computer; and 

executing said remote control module at said second 
computer to establish a remote control communication 
between a user interface at said first computer and an 
application at said second computer. 
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